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Abstract —This paper studies fixed rate vector quantisation for 
noisy networked control systems (NCSs) with correlated packet 
dropouts. In particular, a discrete-time linear time Invariant 
system is to he controlled over an error-prone digital channel. 
The controller uses (quantized) packetized predictive control to 
reduce the Impact of packet losses. The proposed vector quantizer 
is based on sparse regression codes (SPARC), which have recently 
been shown to be efficient in open-loop systems when coding 
white Gaussian sources. The dictionaries in existing design of 
SPARCs consist of independent and identically distributed (i.i.d.) 
Gaussian entries. However, we show that a significant gain can 
be achieved by using Gaussian dictionaries that are shaped 
according to the second-order statistics of the NCS in question. 
Furthermore, to avoid training of the dictionaries, we provide 
closed-form expressions for the reqnired second-order statistics 
in the absence of quantization. 

Index Terms —Vector quantization. Networked control systems. 
Predictive control 


1. Introduction 

L inear Time invariant (LTI) control systems are today 
used in many different places and situations. These 
systems all have in common, that there is feedback from the 
system (plant) to be controlled to the controller, in order to 
maintain the plant in a desired state. In some cases it might be 
desired to have the controller at a different physical location 
than the plant, in which case a wired or wireless network 
connects them. This topology is called a networked control 
system (NCS) and can have many advantages such as lower 
cost, higher reliability and easier maintenance. However, other 
challenges arise, including bit rate limitations, random delays 
and breakdowns, which leave the plant in open loop operation 
and can have severe consequences depending on the situation 

[1H5]. 

NCSs with random independent and identically distributed 
(i.i.d.) packet dropouts and delays have been introduced and 
analyzed in previous works under the terms “packetized pre¬ 
dictive control” (PPC) and “receding horizon control”, where 
plant input predictions are transmitted and stored in a buffer. 
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These can then be used in case a packet that contains input 
signals to the plant does not arrive. In particular, the paper 

[6] shows stability results for cases where the maximum 
number of consecutive packet dropouts is bounded, whereas 

[7] investigates NCSs with bounded time-delays. The works 

[8] , [9] analyze mean square- and stochastic stability of NCSs 
based on a Markov dropout model where an unbounded 
number of consecutive packet dropouts may occur. 

Quantization within the NCS has been studied e.g. in [9]- 
[11], where [11] forces the controller to select the control 
vector from a finite constrained set of vectors using a nearest 
neighbor vector quantizer (VQ), and analyses the closed 
loop behavior of these. In [10], an entropy-coded dithered 
(lattice) quantizer (ECDQ) is used, and closed loop stability is 
investigated using linear matrix inequalities based on Markov 
jump linear systems (MJLSs). Optimal rates for the entropy 
coder are calculated based on the statistics of the NCS. MILS 
stability using ECDQ is investigated in [9], where the authors 
provide bounds on the maximum packet dropout rates which 
preserve stability in the system. The work [12] relates the PPC 
to problems solved in compressed sensing, and investigates 
sparse representations of the control vector using different 
techniques including orthogonal matching pursuit. The authors 
furthermore provide sufficient conditions for stability when the 
controller is used on a network where bounded packet dropouts 
occur. 

The contributions to NCS in this paper focus on using a 
fixed rate VQ in PPC. VQs, in comparison to scalar quantizers, 
have the ability to operate on multiple dimensions. This opens 
up for concepts that are not applicable on scalars, and can at 
least match the performance of a scalar quantizer, although it 
often does better [13, Theorem 10.1.1]. Eixed rate VQs further 
have the advantage, that the network bandwidth requirements 
are fixed. Since most network protocols (such as the IEEE 
802.15.4 based WirelessHART) utilize slotted transmissions, 
using a fixed rate VQ one can fit the information in a slot. This 
has a clear advantage over variable rate coding approaches 
such as entropy based coding, where smaller packets can 
be obtained, but it is still necessary to reserve additional 
bandwidth in case a larger packet has to be transmitted. In this 
work we utilize a VQ which allows one to compress an entire 
vector at once. The dictionary used by the VQ is inspired by 
sparse regression codes (SPARC), which is introduced in [14] 
as efficient codes to compress memoryless Gaussian sources. 
In [8], [15] the packet dropouts in the network are considered 
to be correlated as described by [16], [17]. This produces a 
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Fig. 1. An illustration of the NCS considered with quantizer and buffer added. 
The controller computes a control signal that is quantized and afterwards 
transmitted over the network to the buffer. At every time step the buffer 
updates the actuator input to the plant. 


more real-world description of the network where disturbances 
on the network can occur for small periods of time where more 
frequent packet dropouts take place. In this work we will adopt 
this class of network models and exploit this in the design of 
the dictionaries for the NCS. 

Additionally, we will implement a fixed rate VQ in NCSs 
using receding horizon controllers, where we investigate and 
apply different methods to construct the dictionaries without 
the need of training data. We furthermore investigate network 
models for correlated packet dropouts and design quantizers 
for these. This results in a more realistic representation of the 
network between the controller and buffer. We finally provide 
simulation studies of the quantizer in network setups featuring 
correlated and i.i.d. dropouts. 

Notation: denotes the column vector in matrix F. Let 

a matrix A G denote an m x m matrix and its 

transpose, while B G is a vector containing m elements. 
We further denote by the element in the column 
of a matrix A. For any vector x and square matrix Q, we 
define ||a:||Q = x^Qx and ||at|p = x'^x. The mxm identity 
matrix is denoted by and the n x m matrix containing 
zeros is denoted 0„xm- 

II. NCS WITH FIXED-RATE QUANTIZERS 

The NCS considered is shown in Figure 1, where the 
controller and the plant input are connected through a network 
in which packet loss occurs. In most previous work related to 
NCSs, the dropouts were assumed to be i.i.d. [6], [9], [10], 
[12], such that a packet dropout occurs with probability p 4 
at every time-instance k. We utilize state feedback, where the 
feedback path throughout this work is assumed to be ideal 
with no packet dropouts. 

A. Packetized predictive control (PPC) 

In this work we consider the system shown in Fig. 1, where 
the state of the plant is given by the recursion 

x{k + 1) = Ax{k) + Biu{k) + B 2 Uj{k), fc € Nq, (1) 

with x{k) e describing the plant state at time k. In (1) the 
system matrix of the plant is A € p is the dimension 

of the state vector, u{k) € M is the control signal or input 
and B^ G The plant is affected by a disturbance with 
zero-mean white Gaussian noise uj{k), that is applied through 
B 2 G RP. 

We only consider controllable systems in this work. This 
means, that the matrix 

C = [B, AB, A^B, AP-^B] gRp^p (2) 


has full row rank. This condition can be relaxed to saying that 
the system is stabilizable if the uncontrollable subspace of the 
system matrix A has all of its eigenvalues strictly in the unit 
circle [18]. 

In this work, we assume that the probability for packet 
dropouts pii is non-zero which means, that the computed 
control signal not always will be applied to the actuator. This 
has to be taken into account to achieve the desired closed loop 
performance. See for example [11], [19] and other literature 
on packetized predictive control (PPC). The main idea in PPC 
is that, based on current measurement data, the controller 
predicts which control signals will be applied to the actuators 
in the future. These control signals are transmitted over the 
network as a vector 

u{k) = [u{k), u{k -I- 1), ... , u{k + N — 1)]^ G R^, (3) 

where N is the prediction horizon. The packets are received by 
a buffer, that stores the control signals. At every time instance, 
the buffer verifies whether the transmission of control data is 
successful. If a new packet with control signals arrives, the 
previous signal is replaced in the buffer and the first entry in 
u{k) is applied to the actuator. In case a packet is lost, the 
buffer will apply the next control signal to the actuators. This 
leaves the operation of the buffer as follows 

b{k) = (1 - d{k))u{k) + d{k)Mb{k - 1) e R^, (4) 


where 


01 0 ... 0 



0 

0 


0 1 0 
0 0 1 
0 0 0 


(5) 


is the N X N matrix that cycles the buffer and the parameter 
d{k) indicates whether a packet dropout occurred at time 
instance k. Here d{k) — 1 when a packet dropout occurs. 
This happens with probability pd. The actuator input u{k) in 
(1) is then taken from the top-most entry in the buffer, namely 


u{k) = eib{k), (6) 

where the 1 x N vector ei = [1, 0,..., 0]. 

In the PPC formulation we use the linear quadratic cost 
function 

N-l 

J (u',x{k)) = ||at'(iV)|l3i- + ^ (|la;'(0llQ + Ru'{lf) , 

1=0 

(7) 

where u' = [m'(0), u'(1), ..., u'{N — 1)]^ are the predicted 
actuator inputs and x'{k + l) are the predicted plant states for 
the inputs u'{l) and are given by 

x'{l + 1)= Ax'd) + Biu'd), / e {0,1,..., V - 1} (8) 


with a;'(0) = x{k). Here V > 1 is the length of the prediction 
horizon which equals the size of the buffer in Fig. 1. The 
variables Q ^ 0 G Rp^p, X ^ 0 € Rp^p and i? > 0 € K are 
weighting matrices and scalars that allow for trade-off between 
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control performance and control effort [18]. These parameters 
can be tuned in the design phase until the desired closed loop 


performance is obtained. 

By defining the matrices 


r B, 

AB^ 

■■ 


A^-^B^ A^-'^B 

and 

A 

■ A ' 
A^ 



A^ 


y.N 


(9) 




e 


we can restate the cost function (7) as 

J{u\x{k)) = x'^ {k)'T^'Tx{k) 
+ u'^Wu' + 2x'^{k)Fu', 

where 

W = R + ^'^Q^ gR^^^ 
F = e RP^^ 

and the weighting matrices are given by 
Q ^ blockdiag((5, ■■■ ,Q,X)g 
H=diag{i?,--- ,i?} 


( 10 ) 


( 11 ) 


( 12 ) 

(13) 


(14) 


where X G IRp^p is the symmetric positive definite solution 
to the discrete algebraic Riccati equation 

, -1 


X ^A^XA + Q- A^XB^ {R + BjXB^) 

B^XA, 


(15) 


which exists only if the system (1) is stabilizable [18]. The 
optimal control inputs are then found by 


u{k) = argmin J(m, a;(fc)), 
ueR” 


(16) 


which can be solved analytically and results in the feedback 
law 


u{k) = —Kx{k), 

(17) 

where 


II 

1 

(18) 

is the stabilizing feedback gain. 



Since we in this work focus on bandwidth limited networks, 
it is of high interest that the size in bits of the control packets 
is small. This can be done using vector quantization. The 
papers [9], [10], [12] investigated this idea using different 
quantizers and methods where variable-rate VQs are used. 
Variable rate VQs give the disadvantage, that the demands on 
the communication channel vary depending on the amount of 
bits that are required to store the control signal. This results in 
wasted resources on the channel in case the bit rate has high 
variations. To overcome this problem we, in the present work, 
propose to apply a fixed-rate VQ in the NCS, such that the 
requirements for the communication network do not vary. 


Section 1 Section 2 Section M 

L columns L columns L columns 



Fig. 2. The proposed dictionary based on SPARC, where the vector f3 only has 
one nonzero entry in each section m, that selects a vector from the dictionary 
r and thereby can reconstruct the signal u through the linear combination 

u = r/3. 


B. Fixed rate quantizers for PPC 

In this work we utilize a VQ to compress the control 
signal such that less network bandwidth is required to transmit 
the signal. A vector quantizer is a function, that maps a 
iV-dimensional vector in a space R^ into a finite set W 
containing so-called codewords. This set is often referred to 
as the codebook, thus a vector quantizer Q : M" —>■ W [13]. 

We design the quantizer using a fixed dictionary T that 
is split into M sections which each contains L codewords. 
In this case, the codewords in the set W are composed of 
linear combinations of the codewords in the sections of the 
dictionary T. The dictionary is known for both the quantizer 
and the buffer on the receiver side of the network. The 
dictionary design is heavily inspired by SPARC, presented in 
[14]. The structure of the dictionary in SPARC can be used 
in the design of computationally efficient encoders [20]. An 
additional feature of SPARC is, that it has a low memory 
requirement, since only one section of the dictionary needs 
to be stored in the memory for every iteration. This can be 
advantageous when the algorithm is implemented on micro¬ 
controllers etc. A key difference is, that while SPARC is 
designed to compress large vectors containing i.i.d. data, the 
designed dictionary will be used on shorter vectors containing 
memory due to the feedback in the control loop. Further details 
on the dictionary design are included in Section III. 

Figure 2 illustrates the dictionary F C where N is 

the horizon length of the controller. The vector /3 is an ML x 1 
vector, which only contains one non-zero entry in every section 
m G {1, 2,..., M}, and this entry is 1. A vector (3 can be 
used to estimate a signal u by 

u = r/3, (19) 

where 

u = u — e, (20) 

with e being the quantization error. Using this quantizer, only 
the vector (3 has to be transmitted to the receiver. This vector 
consists of Mlog 2 (L) bits, which gives an effective bit rate 
of 

M logofL) 

R = -bit/symbol. (21) 

From the set B containing all code words, we approximate 
u G R^ by finding the code word f3 G B, for which r/3 is 
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d(k) 



Fig. 3. Closed loop PPC with the quantizer integrated in the cost function 
according to (25). 


closest to u. Thus, given a vector u and some fixed code book 
r, we have to solve the minimization problem 

/3* = argmin ||m — r/3|p. (22) 

/3eB 

The set B is non-convex, which means that the optimization 
(22) is a non-convex optimization problem. In fact, it is an NP- 
hard combinatorial problem [14]. The optimization (22) needs 
to be solved on-line, which can be done using e.g. greedy algo¬ 
rithms such as matching pursuit (MP) [21]. These algorithms 
do not necessarily provide the global optimal solution, but 
often result in a local minimum, which is sufficient depending 
on the application. The algorithm used in the present work is 
explained in Section II-C. 

We implement the quantizer into the controller as shown 
in Figure 3, such that the controller directly operates on the 
finite set of control signals that the quantizer can generate. In 
this way, we propose to operate the controller using the cost 
function 


J{f3,xik)), (23) 

where the cost function is obtained by limiting the control 
signals to be part of the set u G W, where 

W = {r/3 I j3eB}. (24) 

This allows us to rewrite (11), such that the quantized con¬ 
troller cost function becomes 

j(u,x(k)) = x'^(k)r^rx(k) + u^wu 
+ 2x'^{k)Fu, ugW, 


The greedy search is implemented for every section m in 
the dictionary as 

i*^{x{k)) = axgTll\TLj{u(irn),x(k)) 
im 

s.t. (28) 

m —1 

M(tm) = 


for 


*m € ((to — 1)L -I- 1,..., Lm), TO € {1,2,..., M} 


and are column vectors in F. Here L is the number of 
vectors in each section to in the dictionary F. The vector i* = 
\i\, t 2 , ... then contains the indices of the columns in 

the dictionary that minimize (27). This procedure is repeated 
for all M sections in the dictionary, after which the sparse 
vector /3(fc) is formed as 


(3*ik) 


1 if j e i* 

0 if j ^ i* ’ 


(29) 


such that the control signal can be reconstructed as 


u*{k) = ri3*{k). (30) 


We choose to minimize the cost function for one section of 
F at each iteration. The greedy search algorithm is illustrated 
in Algorithm I. 


Algorithm I. Greedy search for the controller in the NCS. 
1: Dictionary F 
2: Input signal x{k) 

3: f3 = OmL 

4: for TO = 1 — )■ M do 

5: for i = L{m — 1) -f 1 —>■ Lm do 

6: u = F/3 + 7i 

7: resi = J{u,x{k)) 

8 : end for 

9: g = argmiUj res 

10 : (3g = 1 

11 : end for 


where the minimizing u is found by 

u{x{k)) = aTgmmJ’{u,x{k)). (26) 

-aew 

The optimization problem (26) is non-convex since it oper¬ 
ates on a finite set which is generated by the dictionary and can 
therefore not be minimized analytically. We therefore propose 
to find the minimizing solution using a greedy method, closely 
resembled to MP. Thus, we select the vector from the first 
section in the dictionary, see Fig. 2, that reduces the cost 
function the most. This selection procedure is then repeated for 
every remaining section. Since x"^{k)'T'^Yx(k) is constant 
for a given x{k), this part can be neglected in (25), reducing 
the cost function to 

J{u,x{k)) = u'^Wu + 2x'^{k)Fu, mgW. (27) 


The performance of the quantizer is highly dependent on 
the design of the dictionary, which is studied in Section III. 

Computation-wise, most of the computations in Algorithm I 
involve the evaluation of the matrix-vector and vector-vector 
products in the cost (27). Here the term x’^{k)F only has to 
be evaluated once at every time step. This leaves one matrix- 
vector and two vector-vector products that have to be evaluated 
ML times, resulting in a total of ML matrix-vector products 
and 2ML vector-vector products at every time-step. The size 
of the matrices W and M depend on the horizon length N. 
Storage-wise, the N x ML dictionary F has to be maintained 
in the memory. This memory footprint can however be reduced 
notably since only one NxL section of the dictionary needs to 
be maintained in the memory for every iteration to. In fact one 
can, by generating the dictionary as described in the following 
sections, generate one vector of the dictionary at a time using 
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Pl2 



P21 


Fig. 4. Model of a network with two states E, where E = 1 corresponds to 
the “good state” featuring few dropouts, whereas E = 2 illustrates periods 
with disturbances in the network, and therefore features higher packet dropout 
probabilities. 

a fixed seed for a random generator. Such a procedure would 
lead to a significant reduction of the memory requirements. 

Remark 1. Alternatively to Algorithm I, one can also provide 
all sections at every iteration and remove the section, when 
one vector in the section is chosen. This can in some cases 
give better results, since the final cost (27) might get reduced 
further. This though comes with a significantly increased 
computational cost, that increases from evaluating (27) L times 
to L{M — m) times for every iteration of m. 

C. Networks with two states 

In this section we model the network in Figure 3 by consid¬ 
ering two network states'. Here each network state represents 
a different probability for a packet loss to occur. This can for 
example be due to congestion or interference. We denote the 
current network state by S(A:) € B, where B = {1, 2}, see also 
[16], [17], [22], [23]. One state describes a reliable network 
situation that features low dropout probabilities, and the other 
state models disturbances on the network. These disturbances 
cause a poor connection for a period of time and therefore 
result in a higher dropout probability. This model is illustrated 
in Figure 4. 


III. Dictionary design 

The dictionary design has a major impact on the per¬ 
formance of the quantizer we proposed in Section II-B. A 
common method to design dictionaries is to use training data 
obtained from the signals to be quantized. This is e.g. done 
in the Lloyd-Max quantizer [24]. An alternative method is to 
use the distribution of the signal to be compressed [14], [20], 
which often is done when memoryless Gaussian sources are 
quantized and the distribution of the source is known or can 
be estimated. 

A drawback when using training data to generate the 
dictionary is, that the system has to operate (or is simulated) 
for a period of time to obtain the desired amount of training 
data. The simulations also have to run for a certain time 
to obtain training data for steady state operation. If only a 
few simulations are used, a dictionary is obtained, that only 
obtains information for the few special simulations. This can 
be omitted when averaging over multiple simulations. As we 
shall see below, when using the statistics of the NCS and 
network, the dictionary can be generated offline without the 
need of training data. This dictionary fits the system as long 
as the statistics of the network do not change. The other 
advantage of using the system statistics for the design of the 
dictionary is that the dictionary can be designed alongside the 
controller, and easily can be modified when the controller is 
tuned. 

We propose to use the distribution of the NCS and the 
statistics of the network to generate the dictionary offline. 
Using this, we can design a dictionary that fits the system 
when the first and second moment of the system are known 
or can be estimated. 

For the ease of exposition we first describe how to design the 
dictionary for a single network state. This will in Section III-B 
be expanded to take the state transition probabilities in P 
into account to design a single dictionary that covers multiple 
network states. 


Assumption 1. The model in Figure 4 is described as a 
discrete-time homogeneous Markov chain 'E,{k) with transi¬ 
tion probabilities pij = Pr {S(fc + 1) = j | 2(fc) = i} for 
i,j € B. Whether a packet dropout occurs or not is con¬ 
ditionally independent given the network state, such that 
Pd,i = Pr {d{k) = 11 S(fc) = z} for z € B. The dropouts d(k) 
are not Markovian, but correlated to S(fc) which is Markovian. 
The augmentation of these processes {d{k),'E,{k)) forms a 
Markov chain that can be classified as a Markov jump linear 
system (MJLS). 

The state transition matrix for the system in Figure 4 is 
given by 


p ^ [Pii P 12 ] 
[P21 P 22 J ’ 


(31) 


We assume that the current network state S(A:) is known to 
both the controller and the actuator, that applies the control 
signal to the plant. This can in practice be done by estimation 
of hidden Markov chains. 


’Extensions to multiple states present no technical difficulties. 


A. Dictionaries considering a single network state 

In this section, we describe the design of the dictionary for 
a NCS with a single network state as described in Section 
II-A. The probability for a packet dropout to occur is pd- 
For the setup considered, we note that the first and second 
moment of the state x{k) of the NCS are given by 


E {a;(fc)} = E {a;(fc)} = E {a:(fc)} = Op (32) 
= Yai {x{k)} =¥. {x{k)x^[k)^ . (33) 

Using (1) and (4), we describe the aggregated system state 

(34) 

at time instance k by 

@{k + l) = A{d{k))®{k) + Bujik) (35) 

where 


A(0) 


A B^ejK OpxN 

-K O^xnJ ^ ^ 


A B^ejM 

_0jvxp M 
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B(0) = B{1) 


B 2 

On 


= B, 


and dfe = 1 when a packet dropout occurred. 


Definition. MSS [9], [25] The linear system (35) is mean 
square stable (MSS) if there exist a bounded /r and Q®, such 
that 


E {0(fc)} —)■/i, fc —>■ 00 (36) 

E {0(fc)©^(fc)} Q©, fc —>■ 00 (37) 

for all initial conditions 0 ( 0 ) with bounded variance and 

d(0)e{0,i}. 


Thus for system (35) to be MSS, we require that the 
first and second moments of (35) converge to a finite value. 
When the packet dropouts are i.i.d., the recursion (35) and the 
distribution of d{k) amount to a MJLS with transition matrix 

[9] 

I “ H . (38) 

- pd Pd 

As described in [25, Proposition 3.6], the MJLS is stable 
in its first moment if it is stable in its second moment. We 
therefore only have to verify that the second moment of 
(35) converges. Since oj{k) is i.i.d. and thereby wide sense 
stationary, it is sufficient to verify that the homogeneous 
system 0(fc + l) = A{d{k))&{k) is MSS [25, Theorem 3.33]. 
The second moment of (35) at time A: + 1 is given by 

Q 0 (fc + l)=E{0(fc + l)0^(fc + l)} 

= E {A{dik))Q@{k)A^id{k))} , 

which can be rewritten using properties of the Kronecker 
product [25] to 

vec{Q@{k + 1)} ='^vec{Qe>{k)} , (40) 


where vecjQ} stacks the columns of Q and 

=E{A{dik)) (g) A{d{k))} e k(p+^)'x(p+^)' 

= (1 - Pd) A(0) (g) A(0) + PdA{l) (g) A(l), 

with (g) being the Kronecker product. The system (35) is MSS 
if Q&{k) —> 0 as A: —> 00 . This occurs only if pd is such that 
all eigenvalues of ^ are within the unit circle. 

In this work we only consider MSS systems, which requires 
that there exists a stabilizing feedback gain (18) and that pd is 
such that (41) has its eigenvalues within the unit circle. Note 
that MSS can be shown using other methods as described in 
[25, Theorems 3.9 and 3.33] and [9, Theorem 2]. 


Lemma 2. If the NCS in (35) is MSS, the variance of uj{k) 
is finite and, in the absence of quantization effects, the first- 
and second-order moments of the state in (35) are given by 
(32) and (33), then 

Q© = lim E {0(A:)0"^(A:)} , (42) 

fc —^00 

which can be computed as 

Q@ — AQqAA + Pd(l — pd^AQ^A + u'^BBA , (43) 


where 

^ = E {A{dik))} = pdA{l) + (1 - Pd)A{0) (44) 

and 


A^ A{1)- A{0). (45) 

Proof: see Appendix A. 

The second moment of the aggregated system state 0(fc) 
found in Lemma 2 can be used to design the vectors in the 
dictionary T using a Gaussian distribution, such that 

7 ,ie{l,2,...,ML} (46) 


where 


Q^ = K [B 


0 ?;] 


Q@ 


Ip 

On 




(47) 


The above result gives statistics of the NCS operating while 
neglecting quantization effects. By creating the dictionary 
using (46) and using a bit rate that is high enough, the granular 
distortion added by the quantizer is small compared to cr^ 
will only have a limited impact on the performance of the 
NCS. When the bit rate is decreased, we can compensate for 
the granular distortion by scaling the dictionary with a factor 
larger than 1 . 

We design two dictionaries using (46). The first dictionary 
is a Gaussian with refinements (GR) dictionary where every 
section m G {0,1,..., M — 1} is generated using (46). In 
the second dictionary (the Gaussian with scaled refinements 
(GSR) dictionary), we, inspired by [20], scale every section 
m € {0,1,...,M — 1}. In [20], the asymptotically optimal 
scaling factor was found to be 

Cm = a§ a f (48) 


for some oq and oi that are independent of m. However, in 
non-asymptotical cases, we have experimentally observed that 
a better choice is to use 


Cm — af^ , 


(49) 


where Oq = 1 and a[ = The scaling factor provides a 
trade-off between granular and overload distortions. Since the 
variance of the signal to be quantized is decreased in each 
iteration (as m increases), the scaling factor ensures that the 
variance of the dictionary elements is decreased accordingly 
to better match the changing input statistics. 

The vectors in the GSR dictionary can then be created using 
the scaling factor Cm from (49) and a Gaussian distribution, 
such that 


‘^mL+i 


CmJA (O^v, Qu) > 


i e {1,2,...,L}, 
me {0,1,...,M-1}. 


(50) 


Using this scaling factor, the variance of the individual sections 
in r decreases as m increases. The idea is, that using the 
greedy algorithm (Algorithm I) on the GSR dictionary, the 
vector that is selected first will reduce the residual in ( 20 ) 
the most. The vector that is selected hereafter will reduce it 
slightly less and so on. This is expected to give a lower residual 
than the GR dictionary, where every section in T has the same 
variance. 
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Remark 2. When there are multiple dropout scenarios, as 
presented in Section II-C, the above described method can 
be used to design a dictionary for each network state. Using 
this approach, the controller and actuator switch dictionaries 
when the network changes from one state to the other. This 
requires that both the controller and actuator know the current 
network state. The dictionaries can in this case be designed 
using (46) and (50) where the covariance is calculated as 
in Lemma 2. Here the first dictionary is designed using 
Pd = Pdi and the second is designed using pd = Pd 2 - In the 
implementation of this. Algorithm II is used to switch between 
the dictionaries in the NCS. Note however, that although the 
dictionaries designed using this method take the individual 
dropout probabilities in the current network state into account, 
they do not consider the transition probabilities to go from one 
state to the other. 


Algorithm II. Modification to Algorithm I to perform greedy 

search with two network states. _ 

1 : Dictionaries ri,r 2 
2 : Input signals x{k),E{k) 

3: r = rs(fe) 

4: Go to Step 3 of Algorithm I. 


B. Dictionary design for two-state networks 

We will in this section describe a single dictionary that can 
be used when there are multiple network states as described 
in Section II-C. The main advantage here compared to the 
method described in Remark 2 is, that the controller and buffer 
do not need to have any information on the current network 
state. This dictionary uses the statistics of the system featuring 
the network model described in Section II-C. The second 
moment is found by adopting the methods described in [22] 
and [23]. The quantizer noise is not taken into account in this 
analysis, and it therefore only shows the performance of the 
NCS without any quantization. This way, under Assumption 
1, the NCS shown in Figure 3 can be described by the jump- 
linear model (35) based on (1) and (4) where d{k) = 1 
indicates that a packet dropout occurred at time instance k, and 
©(/c-l-l) is described by the recursion (35). These models have 
been studied in e.g. [25], where Theorems 3.9 and 3.33 from 
[25] describe necessary and sufficient conditions for MSS. 

Lemma 3. If the system in (35) is MSS, Assumption 1 holds, 
quantizer effects are neglected, the variance of to (k) is finite 
and the second moment of the state in (35) is given by (33), 
then 

Qe = Jhn E{0(fc)0T(fc)} (51) 

jeB 

where 

Qj = ^PijAjQiAj 3- TTjalBB^, (52) 

ieB 


S = j and 

A,=¥.{A(d{k))\^{k)=j) 

= Pd,3A{l) + (1 - pd,,)A(Q) J e B. (53) 
Proof: see Appendix B. 

The dictionaries for the NCS featuring correlated dropouts 
can thus be described using (51). Using this, we design the 
Gaussian dictionaries with refinements for the two state system 
(GR2) dictionary using (46) and (47) with covariance (51) and 
the Gaussian dictionaries with scaled refinements for the two 
state system (GSR2) dictionary where every section m € M 
is scaled using (50). This dictionary can be implemented in 
the NCS using Algorithm I. It should further be noted, that 
this design does not require that the controller and actuator 
have knowledge of the current network state, merely statistical 
information is used. 

IV. Simulations 

In this section we provide simulation studies for the fixed 
rate quantizer on NCSs. We design the dictionaries as de¬ 
scribed in Section III and compare these to the NCS running 
without quantizer and the NCS with the quantizer using 
a dictionary containing Gaussian i.i.d. samples. The latter 
is a simple way to generate dictionaries when quantizing 
Gaussian i.i.d. sources [14], [20] and is expected not to achieve 
a competitive performance compared to the GR and GSR 
dictionaries. We compare the bit rate in bit/symbol against 
the empirical cost of the state in the system and the control 
signal. This cost is calculated as 

MSE=||x(fc)||^ + |l«(fc)|||, (54) 

which is averaged over the length of the simulation. When the 
bit rate is too low, the quantizer may overload and make the 
system unstable. 

In the simulations we use the recursion (1) where the noise 
uj(k) ~ Af{0,a'^) is zero mean Gaussian with variance cr^ = 
1, and the system matrix A is randomly generated as 


-0.758 

-0.325 

-0.085 

0.060 

-2.256 

0.432 

-0.356 

0.002 

0.007 

-0.171 

-0.173 

1.063 

0.366 

0.671 

0.939 

0.951 

0.667 

0.737 

-0.434 

0.352 

1.054 

0.484 

-0.158 

0.454 

-0.264 


(55) 

A has absolute values of the eigenvalues 
1.659, 1.659, 1.241, 0.754 and 0.43. The matrices 
B^ = B 2 = [11111]^, such that the noise and the control 
signal affect all states. This system is fully controllable. The 
weighting parameters used in (14), that are used in the cost 
function (27) are Q = Ts and R = 1. The horizon length N 
is set to 5 and the dictionary T, shown in Fig. 2, contains 
M = 2 sections, since this shows the best performance in 
simulations and maintains stability at lower bit rates than 
a dictionary containing 3 or more sections. The number of 
vectors L in each section is calculated from the desired bit 
rate R by 


with TTj being the stationary probability of the Markov state 


L= [2T] 


(56) 





-^- 

4 4.5 5 5.5 6 6.5 7 


Rate [bit/symbol] 

Fig. 5. Average MSE over 12 simulations. The designed dictionaries with 
stars showing the GR dictionary and circles the GSR dictionary. These are 
compared to the optimal performance of the NCS without quantizer (dashed) 
and an i.i.d. (dash-dot) dictionary. 



Fig. 6. Average MSE over 12 simulations. The designed dictionaries with 
stars showing the GR dictionary and circles the GSR dictionary. These are 
compared to the optimal performance of the NCS without quantizer and an 
i.i.d. dictionary. 


which is rounded towards the greatest integer. The actual bit 
rate is hereafter calculated by solving (56) with respect to R. 
The dictionary T is then designed as described in Lemma 2, 
where the GR dictionary is generated using (46) and the 
GSR dictionary using (50). The control signal u{k) is then 
calculated using Algorithm I 

We run multiple simulations each of 50000 time instances 
over which we average the MSE. The dictionaries are ran¬ 
domly generated and the dropouts are randomized for each 
simulation. If one simulation with a certain dictionary is 
unstable at a given bit rate, all simulations for this dictionary 
at this bit rate are considered to be unstable. 

The dictionaries are scaled by a fixed scaling that results in 
the best performance. The i.i.d. dictionary is generated using 
a Gaussian distribution with = 25, which provides the 
best performance in MSE compared to bit rate without being 
overloaded at lower bit rates. The GSR dictionary is scaled by 
a factor 2, whereas the GR dictionary is scaled by 1. 

A. NCS with i.i.d. dropouts 

We first simulate a NCS with a single network state fea¬ 
turing i.i.d. random packet dropouts with the probability pd, 
which is set to 0.10 in this simulation. Eigure 5 shows the 
average MSE over 12 simulation runs. 

The results show that the GSR dictionary (that is gener¬ 
ated using (50)) can maintain stability at bit rates down to 
4.8 bit/symbol. The MSE is less than 1 dB higher than the NCS 
without any type of quantizer, and is reduced to only 0.1 dB at 
7 bit/symbol. This is a significant performance improvement 
compared to the i.i.d. Gaussian dictionary where the MSE 
reaches 21.6 dB already at 6.4 bit/symbol, while the GSR 
dictionary stays below this even at a rate of 4.8 bit/symbol. 
The GR dictionary (generated using (46)) maintains stability 
at bit rates of 5.8 bit/symbol, where it results in identical 
performance, with respect to MSE as the GSR dictionary. 

Eigure 6 shows the results when the dictionaries use an 
additional scaling factor of 2, such that the GR dictionary is 
scaled by a factor 2 and the GSR is scaled by a factor 4. The 
MSE is slightly increased compared to Eigure 5 for higher 
bit rates, but the system is stable at lower bit rates. The GSR 


dictionary is able to maintain stability at bit rates down to 
4.2 bit/symbol. The GR dictionary results in a slightly lower 
MSE, but is unable to maintain stability at bit rates lower 
than 4.6 bit/symbol. The MSE of the i.i.d. Gaussian dictionary 
increased compared to Eigure 5, but is able maintain stability 
at bit rates down to 5.2 bit/symbol. 

Both simulations show that all dictionaries asymptotically 
approach the optimal MSE of the unquantized NCS as the bit 
rate increases. In Eig. 6, there is only 0.11 dB difference in 
the MSE between the optimal MSE from the NCS with no 
quantizer and the GR and GSR dictionaries. 


B. NCS with correlated dropouts 

We simulate a system featuring a network that is modeled 
as shown in Eigure 4 using two network states. The transition 
matrix is defined by 


0.95 0.05 
0.25 0.75 ’ 


(57) 


and the dropout probabilities pdi = 0.05, Pd 2 = 0.15. Here 
the dictionary design for the GR and GSR dictionaries is done 
as described in Remark 2. Using these dictionaries, the control 
signal u{k) is computed using Algorithm II. Eor the GR2 and 
GSR2 dictionaries, the dictionary design is done as described 
in Lemma 3, where the GR2 dictionary then is generated using 
(46) and the GSR2 dictionary using (50). The control signal 
u{k) is then computed using Algorithm 1. 

The dictionaries overload when these are scaled with the 
earlier mentioned factors, and are thereby unable to maintain 
stability. We therefore change the scaling factors such that the 
stability and the MSE at a rate of 7 bit/symbol are maintained 
for the different dictionaries. Thus, the GR dictionary is scaled 
by 2, the GR2 and GSR2 dictionaries are scaled by 3, the GSR 
dictionary is scaled by 4, and the i.i.d. Gaussian dictionary is 
scaled by 2, such that here = 100. Eigure 7 shows the 
results averaged over 24 simulations. 

The GR dictionary shows a better performance at low 
bit rates compared to he GSR dictionary, but generally has 
a higher MSE. The GSR2 dictionary shows the far best 
performance, being able to maintain the system stable at bit 
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4.5 5 5.5 6 6.5 7 


Rate [bit/symbol] 


Fig. 7. Average MSE over 24 simulations. The designed dictionaries with 
stars showing the GR dictionary and circles the GSR dictionary. The diamonds 
and triangles show the GR2 and GSR2 dictionary, respectively. These are 
compared to the optimal performance of the NCS without quantizer and an 
i.i.d. dictionary. 


rates down to 4.5 bit/symbol, which is far below any other dic¬ 
tionary. The GR2 dictionary performs slightly worse than the 
GR dictionary. It should here though be noted, that the GR and 
GSR dictionaries assume that the controller and buffer know 
the network state at every time instance, whereas the GR2 and 
GSR2 do not need this information. The dictionary containing 
i.i.d. samples generally has a higher MSE at comparable bit 
rates to the designed dictionaries. 

The simulations generally show, that the risk of overloading 
the quantizer is reduced when the scaling of the dictionaries 
is increased. This scaling though results in a higher MSE for 
comparable bit rates. 

The simulations show that the proposed dictionaries re¬ 
sult in a significantly improved performance compared to 
a dictionary consisting of simple i.i.d. Gaussian generated 
variables. The performance of the quantized NCS is however 
highly dependent on the system matrix A, the variance of 
the system disturbance cr^ and the packet dropout probability 
Pd- The system matrix A and pd are linked through the 
second moment of the recursion (35) through (41). Here it is 
important to mention that the system matrix A is determined 
by the dynamics of the system to be controlled [26]. Eurther, 
the packet dropout probability pd depends on the network 
(network load, interference etc.). The higher the eigenvalues in 
(41) the more “flat” the distribution (42) becomes. This results 
in more granular distortion since the entries in the dictionary 
are more wide-spread, which then results in a higher MSE and 
a higher bit rate is required to maintain stability. 

The impact on the performance of the quantized NCS when 
the network is considered Markovian is further affected by 
the transition matrix P, which also depends on the network 
through which the controller and system are connected. The 
impact of the transition probabilities in P on the performance 
of the quantized NCS directly depends on the underlying 
packet dropout probabilities pdi and pd 2 - To illustrate the 
impact of the packet dropout probabilities affecting the “bad” 
state of the network, we sweep pd 2 in simulations while P 
is maintained as in (57), pdi = 0.5 and A is as in (55). The 


24 


23 

m 

I 22 


21 


0.00 0.05 0.10 0.15 0.20 0.25 0.30 

Pd2 

Fig. 8. The MSE shown at different rates for the GSR2 dictionary and the 
system using the optimal control input. Here pd 2 is swept while p^i and P 
are kept constant. 
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results of this are shown in Eig. 8. The figure illustrates that 
stability can be maintained at higher packet dropout rates in 
the “bad” network state as the bit rate increases. The reason 
for this is that the system is less affected by the distortion that 
is introduced when the quantizer is overloaded. 

V. Conclusions 

We have presented a quantized controller for NCS, that fea¬ 
tures a fixed rate VQ. The performance of this setup is highly 
dependent on the design of the dictionaries used. Simulations 
show, that the proposed dictionaries perform significantly 
better than a dictionary containing i.i.d. random samples. Per¬ 
formance approaches the MSE of the NCS without quantizer 
when the bit rate increases. The GSR dictionary generally 
shows a slightly better performance and overloads at lower 
bit rates than the GR dictionary. When assuming correlated 
dropouts, the GR and GSR dictionary also outperform the 
i.i.d. dictionary. This scenario is also tested using the GR2 
and GSR2 dictionaries, that utilize a MJLS model to de¬ 
scribe the stationary covariance of the NCS, where the GSR2 
performance generally outperforms the other dictionaries. An 
additional advantage with the GR2 and GSR2 dictionaries is, 
that the controller and buffer do not need to know in which 
state the network is. 


Appendix A 
Proof of Lemma 2 

Proceeding as in [27], the covariance of the PPC is based 
on the dropout probability pd, which in this case is known. 
The covariance of 0(fc) in (35) can then be described by 

Q^{k + 1) = E {©(fc + l)0T(fc + 1)} 

= .4E{0(fc)0'^(A:)}.4'^+ (A.l) 

Pd{l-pd)M{&{k)&^{k)}A^ + alB^Bl, 

where 

.4. = E {A{d{k))} = pdA{l) -I- (1 - Pd)A{0) (A.l) 

.4=A(1)-24(0) (A.3) 

B = E{B{d{k))} = B. (A.4) 
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We rewrite (A.l) to 

Qe(fc + 1) = AQQ{k)J^ 

+ P(i(l — 

where the stationary covariance can be found by 


Qq = lim QQ{k). (A.6) 

fc—>-oo 

This can be solved by finding the symmetric Qq > 0 that 
satisfies the linear matrix equation (43), which either can be 
done by iterating (A.5) or by using the closed form solution 
described in Remark 2 in [27]. 

The matrix Qq contains the covariances of the the state x 
and buffer b from (34) 


Q& — 


Ejfia;'’’} Qi^ 


(A.7) 


We are interested in the covariance of u, which according to 
(33) depends on the covariance of x{k), denoted Q^, which 
is the upper diagonal part of Qq 

By isolating the covariance Q^ of the plant state x, the 
covariance of the controller output u is given by 


Q^^Kln 0 ]Qq 


K' 


(A.8) 


Appendix B 
Proof of Lemma 3 


This proof follows the procedure of [23]. Using the law of 
total expectation, we have 


E{©(fc + l)©T(fc + l)} 

jeB 

xh 

Q^{k + l) = E{&{k + 1)©T(A: + 1) I Eik) = j} 
X Pr{E{k) =j} 


(B.9) 


(B.IO) 


Using assumption 1 on (35), we write 


E{©(fc + l)©T(fc+l)|S(fc)=j} 

= E {{A(d{k))&{k) + Buj{k)) {A{d{k))&{k) 


+Buj{k))'^ ^{k) = , 


(B.ll) 


which can, considering uj{k) being white Gaussian noise, be 
rewritten to 


E{©(fc + l)©'^(fc + l) |S(fc) = j} 

= E {A(d(fc))©(fc)©'^(fc)A^(d(fc)) 
+Boj{k)uj{k)BT^\E{k) = j} 

= E {A{dik))&{k)&'^{k)A^{d{k))\E{k) = j} 

+ BalB^. 

(B.12) 


Using the law of total expectation, we can write 

E{A{d{k))&{k)&^{k)A^{d{k)) \ E{k) = j} 

= J2^{Mdik))&{k)&^{k)AT'id{k)) 

»6B (B.13) 

E{k) = j,S(fc-l) =i| 

X Pr {E{k — 1) = 1 1 S(A:) = j} . 


Using Bayes rule, this is rewritten to 
E {A(d(fc))©(fc)©^(fc)A'^(d(fc)) I S(fc) = j} 
= J2^{Md{k))@ik)&^{k)A^{dik)) 


iei 


l^(fc) =j,^{k-l) = i} 

Pr {5(fc) = j I E{k — 1) = z} Pr {E{k — 1) = i} 
"" Br{E{k)=j} 

= '^Pi3^{A{d{k)) I E{k) =j,'E.{k - 1) = i} 

ieB 

X E {©(fc)©T(fc) I E{k) = J, E{k - 1) = i} 
xE{A'^id{k))\E{k)=j,Eik-l)=i} 

Pr {E{k — 1) = z} 

Pr{S(fc)=j} 

= Y.P^JA^ E {©(fc)©T(fc) I S(A: - 1) = z} 


Pr {E{k — 1) = zl 
^ Pr{S(fc)=j} ■ 

This can be inserted in (B.12), such that 
E{©(fc+1)©T(A: + 1)|S(A:) =j} = 

^Pyv4j-E{©(/c)©T(fc) |s(fc- 1) =z}X 


(B.14) 


Pr{S(fc-l) = i} 




Pr{^(A:) = j} 

Inserting this in (B.IO) results in 

+ 1) = E {©(fc)©T(fc) I Eik - 1) = z} 

X Pr {E{k -l)=i}Aj + BalB^ Pr {Eik) = j} 
= J2p^JA^Q^ik)AJ + alBB^Pr{Eik)=j} (B.15) 


Since the NCS (35) is assumed to be MSS, it is according 
to [25, Theorem 3.33] asymptotically wide sense stationary 
(AWSS). By defining Qj = \im.k-^oo Qjik), j € B, where 
every 5(fc) is aperiodic, (B.15) becomes (52) and (B.9) 
whereas (B.9) becomes (51). 
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